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Extended Hybrid Model Reference Adaptive 
Control of Piecewise Affine Systems 

Mario di Bernardo *, Umberto Montanaro , Romeo Ortega f 

and Stefania Santini * 


Abstract 

This note presents an extension to the adaptive control strategy 
presented in [T] able to counter eventual instability due to disturbances 
at the input of an otherwise £2 stable closed-loop system. These 
disturbances are due to the presence of affine terms in the plant and 
reference model. The existence of a common Lyapunov function is 
used to prove global convergence of the error system, even in the 
presence of sliding solutions, as well as boundedness of all the adaptive 
gains. 


1 Introduction 

As notably highlighted in [2], adaptive control of switched systems is still an 
open problem. Recently, a novel model reference adaptive strategy has been 
presented in [1] that allows the control of multi-modal piecewise linear (PWL) 
plants. Specifically, a hybrid model reference adaptive strategy was proposed 
able to make a PWL plant track the states of an LTI or PWL reference model 
even if the plant and reference model do not switch synchronously between 
different conhgurations. While stability is guaranteed for PWL systems, for 
affine systems the presence of a non-square integrable disturbance term in 
the error equations and the possible occurrence of sliding solutions can render 
the proof of stability inadequate. 
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We wish to emphasize that the problem of large state excursions and 
instabilities caused by constant input disturbances on the closed loop system 
is a common problem of adaptive control systems seldom highlighted in the 
literature (see for example 0 . 111 . and Sec. 4.4.4 p. 1T3). Indeed, adaptive 
systems can be represented as the negative feedback interconnection of a 
passive system (defined by the estimator) and a strictly positive real (SPR) 
transfer function. A simple application of the passivity theorem establishes 
that the overall system is £ 2 -stable. However, this property does not ensure 
that the system will remain stable in the presence of external disturbances 
which are not £ 2 - A simple example of this scenario is the following system 


= /i(a;i,a;2) =-a;ia;2Cosa;2 

X2 = f2iXl,X2) = xlcOSX2 - X2 + TT, 

where the presence of the constant input tt can cause exponentially growing 
trajectories that can significantly disrupt performance. 

The aim of this note is to present a modification of the control strategy 
presented in PQ able to guarantee asymptotic stability of the closed loop 
system even in the presence of sliding mode trajectories and bounded Coo 
perturbations due to the affine terms in the description of the plant and/or 
reference model. The idea is to add an extra switching action to the controller 
in [1] able to compensate the presence of such a disturbance. The proof of 
stability is obtained by defining an appropriate common Lyapunov function 
and analyzing its properties along the closed-loop system trajectories within 
each of the phase space regions where the plant and reference model are 
characterized by different modes, and along their boundaries. We show that, 
even in the presence of possible sliding mode trajectories, the origin of the 
closed-loop error system is rendered asymptotically stable by the extended 
strategy presented in this paper. A preliminary version of the algorithm 
suitable to control bimodal piecewise affine system can be found in 0.0. 
while experimental validation results are reported in [9]. A possible extension 
to discrete-time piecewise-affine (PWA) plants can be found in [10], [TT] . 

2 Problem statement and definitions 

Assume that the state space iR" is partitioned by some smooth bound¬ 
aries into M domains, say with A4 = {0,1 ,..., M — 1} such that 

= iR” and, given two generic indexes R and 22 E A4 (with R 7 ^ 22 ), 
it follows n = 0 . 
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Let the plant be described by an n-dimensional mnlti-modal PWA system 
whose dynamics are given by: 


X = AiX + Bu + Bi if X EVti, i G Ad, 


( 1 ) 


where x G -K" is the state vector, u E Mis the scalar inpnt, and the matrices 
Ai, B, Bi (i = 0 , 1 ,..., M — 1 ) are assnmed to be in control canonical form, 

i.e. 


A. = 


-1 

o 

1 ■■ 

1 

o 


' 0 ■ 


' 0 ' 

o 

0 ■ 



0 


0 

1 

, B = 


, Bi — 




-• —• 

(2) 

a* • • 

1 


b 


. . 


( 2 ) 


with 6 > 0 . Note that all entries on the last row of the plant matrices Ai, 
B and Bi are snpposed to be nnknown. (Notice that many generic bimodal 
PWL continnous systems can be transformed into snch a form as shown 
in [ig.) 

The problem is to hnd an adaptive piecewise feedback law u{t) to ensnre 
that the state variables of the plant track asymptotically the states, say x(t), 
of a reference model independently from their initial conditions. 

Here, we assnme that the reference model can be either an LTI system, 
or a mnlti-modal PWA system: 


X = AjX Br + if x G %, i E M, 


where the state x E M^, M. = < 0 , 1 ,..., M — 1 


a 


i&M 


( 3 ) 

is a partition of 


M^ into M domains obtained by some smooth bonndaries and r E Mis the 
input to the reference model. Note that the reference model may possess a 
number of modes different from the one of the plant, M ^ M. Furthermore, 
we assume that the reference model dehned as in ([3]) is chosen so as not to 
exhibit sliding solutions and that it is well-posed given the initial condition 
x( 0 ) = xq. In many practical cases, the aim of the control action can be that 
of compensating the discontinuous nature of the plant. In these situations, 
the control design presented above offers a simple and viable solution for this 
to be achieved by simply choosing a smooth or smoother reference model. 
This often corresponds to the conventional choice of an asymptotically stable 
LTI reference model in the case of smooth systems. 

As for the plant, the matrices of the reference model are chosen to be in 
the companion form given by (z = 0,1 ,..., M — 1): 


3 









0 

1 ■■ 

■ 0 


■ 0 ■ 


■ 0 ■ 


0 

0 ■ 


,B = 

0 

A = 

0 

2 

2 

-( 2 ) 

aX ■ ■ 

2 

1 

b 

A. 


with b> 0. 

In what follows, we use the standard notation in [13] (also adopted in 
|14j). for both the switching instants of the plant and reference model. More 
precisely, the switching sequence of the plant is given by: 


S = { xo,{io,to) ,{i2,t2) ■. ■{ip,tp)... \ ip e M,p e IN }, ( 5 ) 

where to = 0 is the initial time instant and Xq is the initial state. Note that, 
as in ra. when t G [tp ;tp+i), then x{t) belongs to by dehnition and, 
thus, the Zp-th subsystem is active. Obviously, the switching sequence S may 
be hnite or inhnite. If there is a hnite number of switchings, say p, then we 
set tp+i = oo. 

For any j G A4, we denote the sequence of switching times when the j-th 
subsystem is switched on as: 

^/j = { I = j and s G IV } , (6) 

and, thus, the endpoints of the time intervals when the j-th subsystem is 
active can be given as: 

{ ^j2+n ■ ■ ■, ... I Zj, = j and s G IV } . (7) 

Analogously, we dehne the switching sequence of the reference model as: 

E = I Xo, (zo, to) , (h, h) , (z2, a) ■ ■ ■ (ipNp'j ... | ip G AI,p S IV | , (8) 

with to = 0. Hence, when t G [tp ;tp+i) then x{t) G by dehnition and the 
Zp-th subsystem is active. 

For any j G Ad the sequence of switching times when the j-th subsystem 
of the reference model is switched on can be analogously dehned as: 

l%,=j,seiv}, (9) 

with the endpoints of the intervals where the j-th mode is active being: 

{ %+i,4+i,• • •,%+i,• • • I %=3,se]N Y (10) 
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We define the ’’switching signals” a : IR^ i—)■ M. and a : IR^ e-)■ M. as: 

a{t) = i ii x{t)EVLi, a{t) = i if x{t)EVL2 (11) 

and the indicator functions ai{t) and a-j-(f), as: 

1 if x (f) 6 flj, 

0 elsewhere, 

a-it) = [ ^ ^ 

* \ 0 elsewhere, 

with i = 0,1 ,..., M — 1 and i = 0,1,..., M — 1. 

Also, e„ G -K" is defined as the basis vector 

e„= [ 0 ... 0 1 

3 Control Strategy 

The control problem described in Section |2] can be solved by means of an 
extended switched adaptive strategy as described in the rest of this section. 
The proposed approach extends the work presented in pQ by exploiting an 
additional adaptive switching control gain to cope with the presence of the 
bounded piecewise constant input acting on the closed-loop system when the 
plant and/or reference model are PWA. 

Assumption 1 Assume there exists a matrix P = > 0 such that 

FA-+AfP<0 T= 0,1,2,..., M-1. (15) 

Given the above assumption our main result can be stated as follows. 

Theorem 1 Consider a PWA plant of the form ([T]) and a PWA reference 
model of the form ([3]). If the dynamic matrices of the reference model 
verify AssumptionUl then the piecewise smooth adaptive control law: 

u{t) = Kjiityit) + Kpsityit) + KAit), (16) 

where 

Knit) 

KpB (t) 

KAit) 
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= a [ ye {t) r {t) dr + (lye {t) r {t) , (17) 

Jo 

= Ko (t) + As (f) + As (t) , (18) 

= Kqa (t) + Asa (t) + Asa (t) (19) 



( 12 ) 

(13) 

(14) 


with 


A /O A /O A T T~) 

ye^CeXe, ^ X - X, ^ C^P, 


Ko{t) 
K^it) 
Kj it) 
K-it) 
KoAit) 
K^a it) 

Kaj it) 

Kxjit) 


a He (r) x'^ (r) dr + (dye (t) x'^ it ), 

Jo 

M-l M-1 

i=i J=i 

P Ve ir) (r) dr, if x G , 
0 elsewhere, 

P II Ve (^) i^) dr, if X e 

js 

0 elsewhere, 

P / yeir)dT, 


JO 

M-l 


M-l 


(t) = A'^jSj 


i=i 


i=i 


plljeir)dT, if xe^j, 
0 elsewhere, 

pllyeiT)dT, if xeh-^, 

3s 

0 elsewhere. 


( 20 ) 

( 21 ) 

( 22 ) 

(23) 

(24) 

(25) 

(26) 

(27) 

(28) 


and a, (3 and p being some positive scalar constants, guarantees that the state 
tracking error Xeit) between the plant states x(t) in ([1]) and the reference 
trajectory x(t) in ([3]) converges asymptotically to zero, i.e. Yrnit^ooXeit) = 0. 


Remarks 

• The adaptation law presented above consists of three gains Kr, Kq and 
Kqa that remain switched on whatever the modes which the plant and 
reference model are evolving in, together with some gains Kj, K-j, 

and KyQ that are switched on only when the trajectories of the plant 
or reference model enter certain domains in phase space. Specihcally, 
the switching gains Kj and KAj are associated to changes of the mode 
of the plant, whereas the switching gains and K^-j are associated 
to those of the reference model. Furthermore, the gains Kr and Kq 
have the same structure of the gains in the Minimal Control Synthesis 
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(MCS) approach [13], an application of Landan’s Model Reference PI 
Adaptive Control scheme [TB]. 

• In order to compensate the bonnded distnrbance acting as an inpnt 
onto the closed-loop error system, the extended strategy exploits the 
additional adaptive term K^it) when compared to the previons version 
of the algorithm presented in [ 1 ], which is a set of switching integral 
actions nsed to properly compensate the affine term in each region. 

• At the generic tj^-th commntation, the adaptive gains Kj and Kaj 
are initialized to the last valne assnmed by that gain when the trajec¬ 
tory of the plant x{t) last exited from region VLj (or zero otherwise). 
Analogonsly, the adaptive gains iPj and Kjq at the generic - th 
commntation, is initialized with the last valne assnmed by that gain 
when the trajectory x{t) left the cell (or zero otherwise). Hence, 
according to the notation nsed for the switching instants, we have: 


I<i (ij.) 

= Kj , S > 2, 

(29) 

i^js) 

= Kaj , s > 2 , 

(30) 

A(h) 

^ (%-i+i) ’- 2) 

(31) 

% (h) 

^ (jls-i+i) ’ - 2 - 

(32) 


Note that at the hrst transition the adaptive gains are set to zero, i.e. 

= 0 , = 0 , = 0 , = 0 , %(%) = 0 . 

Fnrthermore, the integral part of the adaptive gains Kpi and Kq in f[T7)) 
and fl 2 ll) are set to zero at time zero. 

• Both control gains Kji and Kq in f[T7)l and have integral and pro¬ 
portional terms. It is worth remarking that the nse of integral pins 
proportional adaptation has a benehcial effect npon the convergence of 
the generalized state error vector in comparison to the nse of integral 
adaptation, specially at the beginning of the adaptation process pffi] . 
PI adaptation has also been nsed in [3]. 


4 Proof of stability 

We now give the proof of Theorem [1] which is based on constrncting an 
appropriate Common Lyapnnov Fnnction (CLF) for the closed-loop system. 
Note that, dne to the presence of discontinnities in the closed-loop system 
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dynamics, the error state dynamics Xe{t) is evalnated in the sense of Filippov 
Cl and hence, to prove convergence, the Lyapnnov fnnction is also analyzed 
dnring possible instances of sliding motion. 

As the reference model ([3]) does not admit sliding solntions by constrnc- 
tion, we consider for the switched closed-loop error system the following 
time-varying domains: 


e iR’" : x{t) - Xe e (33) 

with Ad = {0,1,..., M — 1}. Fnrthermore we dehne as their bonnd- 

aries. (Note that when the error trajectory Xe{t) evolves along dQ'^{t), the 
plant dynamics exhibit sliding motion along the snrface dQi.) 

From dehnition fl33|l . it is now possible to express the indicator fnnction 
o’iit) in flT^ as a fnnction of the state tracking error as: 


(Ji (t) 


1 ifxe (t) G 

0 elsewhere. 


(34) 


From fl23|) - fl241) and fl?r)) - fl28|l . it trivially follows that, at any given time in¬ 
stant, only one of the pairs of adaptive gains {KiKai), {K 2 Ka 2 )-i ■ ■ ■, {Km-iKam-i 
and one of the pairs (iFiiF^i), {K 2 KA 2 ), ■ ■ ■, can be different 

from zero. Hence, eqnations fl2^ and fl26ll can be easily rewritten as: 


M-l ^ M-1 ^ 

Ke (i) = E (i) K, (i). Ki it) = E % (i) Kj (*). 

J-i (35) 

K^a it) = E it) Kaj, Kj:a it) = E E (^) 

j=i j=i 

with cTj and aj dehned as in flM)l and f[T5]) . respectively. 

Given expressions fl35ll . the adaptation law of the control gains ([23]), 
m, dziD, m can be rewritten in terms of the indicator fnnctions as 

(i = 1,T= 1): 


K^ 

= pyeit)x^ii)ai{i), 

(36) 


= pyeit)x^it)di{t), 

(37) 

Km 

= pyeit)(Ti{t), 

(38) 

Km 

= pyeit)a-i{t). 

(39) 


Now, from the plant and the reference dynamics given in ([T]) and (|3]), respec¬ 
tively, by nsing the dehnition of the control strategy in f[T6|l . after some alge¬ 
braic manipnlations the dynamics of the state tracking error can be rewritten 


as follows: 


where 


Xe = X-X = Am)Xe + Gn'lplW - enh(3yeW'^W+ 
M-l M-1 ^ 

+en Y. (Ti'ljjiX + en Y 

i=\ 

M-1 ^ M-1 

+en + Y + E 

i=l 


( 40 ) 


^ r 
w = [ 

T 

X 

r \ , 




(41) 


T 

1 

A 

O 

) - bKl 

; b 

1 

1_1 

(42) 

'ipi = 

'elAAi - bK,] 

, AA, A 

^0 — 

Aj, 

(43) 


- bK^_ 

, = 

Ay- 

Ao, 

(44) 

i^AO = 

(bo 

1 

1 



(45) 

^Ai- 

%- 

-bKxi, Sk={k- 

bo), 


(46) 

'IpAi = 

5h- 

- bKAi, Sbi A (bi - 

bo), 


(47) 


with if'g, being the integral part of Kq in and in ([T7D . respectively, 
and i = 1,... M — 1, z = 1,... M — 1. Now, by means of the dehnition of the 
adaptive gains given in fITTD . ([21]), (|2S|), (|3S|), (EZ|), (ESj), (1321), the dynamics 
of ipi, 'ifr-, 'll)AO, 'if^Ai and iIjjQ in can be written as: 


'tpj = -bayeW, 

(48a) 

(i = -bpyexai, 

(48b) 

AT 

Vy = -bpyexa--. 

(48c) 

QJ 

1 

o 

(48d) 

pye^^ii 

(48e) 

^Ai = -PVehdq. 

(48f) 


Note that, letting z{t) E pg |^pg state vector embedding the 

adaptive gain dynamics (Il8|) as well as the state tracking error fl30|) the 
evolution of the closed-loop system (HUD . (H5]) can be recast in a more compact 
form as the following set of differential equations with discontinuous right- 
hand side: 

z{t) = fi{z) Xe{t) E i = 0,..., M - 1. (49) 


9 








where /* are the vector fields defined as the right-hand sides of the closed- 
loop system fffll . fllg]) . 

Now, let PA- + A^P = —Qi for some Qi = Qj > 0, i 6 and let V : 
jf^(n+i)(M+M)-i pg Lipschitz, regular [18] and positive definite 

candidate Lyapunov function given by: 


M-l M-1 ^ ^ 

V = x^Pxe + ^ E ^ E + 

^—1 i=l 

M-l M-l ^ 

+ j-b'^A0 + jb ^ ^Ai + jb ^Ai- 

^—1 i=l 


(50) 


To prove asymptotic stability of in what follows we will first evaluate of 
V in the interior of each generic region and then along the generic surfaces 
dSi resulting from intersections of the manifolds (here I = 1,... ,L'i L 
being the number of manifolds where sliding is possible) [TU] : 


H 


ds, = n aai, 

d=l 


(51) 


with H < (M — 1). 


4.0.1 Evaluation of V in 

In the interior of each region Xe{t) G the error system (1491) is a smooth 
set of differential equations composed by equations fl40l) . flT8l) with a and a 
taking finite constant values associated to the active modes of the plant and 
reference model in that region. The time derivative of V along the trajectories 
(HOD can be computed as: 


2 2 2 ^ 

L = -xlQ^(^t)Xe + ^ E E + 

i—\ 

V M-l M-l ^ 

+2x^P enipiw - eAPyew'^w + Cn e„ 

i=l 1=1 

r M-l M-l ^ 

+2x'^Pen 'lpA0+ E AA^(r^it))+ AaPA)) 

'^ — 1 2 — 1 

M-l . M-l ^ X 

^V'AoV'AO + ^ E + E V'mV'aT- 


( 52 ) 


ph ^ ^Ai^Ai’ 
?=1 


Substituting fl48ap - fl48fj) into equation fl5^ and taking into account that 
x^Pcn = e^Pxe = Ve, after some algebraic manipulations we have: 


V = —Xg QffXe — 2b(3y^w^ w < 


— mm 


i&M 


(Amin[Qy])||a:e|P = -W{Xe), 


(53) 
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where Amin[Q 7 ] is the smallest eigenvalue of Q:-. 

4.0.2 Evaluation of V along the manifolds dSi 

In this case two different situations may occur; (i) the trajectory Xe{t) crosses 
the generic manifold dSi fl5T]) over a time interval of zero Lebesgue measure, 
or (ii) it exhibits sliding solutions. In the former case, the crossing has no 
effect on the stability analysis. Therefore, we focus below on the case where 
sliding occurs. 

In particular, when sliding takes place, solutions should be interpreted in the 
sense of Filippov na. Using Filippov convex method, we consider the sliding 
vector held, say fp, obtained by the convex combination 1201: 


M -1 

fp := ^ith 7i(z) > 0; (54) 

i=0 

where fi are the vector helds dehned in equation and ^ lii^) = 1- 
Note that in the general case this is an underdetermined system of equations, 
hence there is no uniquely dehned Filippov sliding vector. Since the following 
stability analysis does not depend on any particular choice of Filippov vector 
held, we do not consider this issue. 

From flHTj) . after some algebraic manipulations it is possible to write the 
closed-loop dynamics flTnil . flT8|) during the sliding motion as: 


Xe = + eni>iw - enb/Sye'w'^w + en 

i=l 

M-1 ^ M-1 

+^n E + e„ E + 'IpAi) 

'i = ^ —1 


M = —bayeW, (55b) 

'ijjJ' = -jibpyeX, (55c) 

^ = -bpyexa--, (55d) 

'ipAo = -pyeb, (55e) 

i^Ai = -libpye, (55f) 

^Al = -PVeb^p (55g) 


where only quantities depending on discontinuities due to plant switchings 
are convexihed as the reference model is assumed not to exhibit sliding. 
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Evaluating the derivative of V flSU]) (again in the sense of Filippov) along 
trajectories of fISSD . some algebraic manipulations yield: 

V < -min(Amin[Qi])||a:e|l^ = -W(xe). (56) 

ieM 

4.0.3 Stability of the closed-loop adaptive system 

From fl5^ and fl56|l . it follows that for almost all t 

V < -W (xe) < 0 a.e. t, Vxg W^pI, ipt, V’ao, i^Ai, 

The derivative of the Lyapnnov fnnction along Filippov closed-loop solntions 
is negative, hence the origin of the closed-loop system is globally stable in 
the Filippov sense [T8] . 

Now following the approach in IZH, from fl57l) for any closed-loop trajectory 
we have 

sup V <C Vt > 0, (58) 

iG[0-|-oo) 

with C being a sufficient large positive constant. 

From fl57)) and fl55]) . it follows 


W{xe{t))dt<C. (59) 

Since W (xg) is a continnously differentiable positive-dehnite fnnction, W (xe(t)) 
is uniformly continnos. Exploiting Barbalat’s Lemma, W{xe{t)) converges to 
0 as f —)■ oo, hence the state tracking error Xe(t) converges to 0. □ 

5 Conclusions 

We have presented an extension of the hybrid adaptive strategy introduced in 
[1] aimed at compensating possible instabilities dne to the presence of sliding 
mode trajectories and bonnded pertnrbations acting on the closed loop error 
system. The external disturbances are due to the presence of affine terms 
in the plant and reference model dynamics. Using an appropriate common 
Lyapnnov fnnction, we have shown that the extended strategy guarantees 
asymptotic convergence of the tracking error, even in the presence of sliding 
solutions, as well as bonndedness of all the adaptive gains. 
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